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Abstract — This paper provides an explicit expression for the 
capacity region of the two-user broadcast Z channel and proves 
that the optimal boundary can be achieved by independent 
encoding of each user. Specifically, the information messages 
corresponding to each user are encoded independently and the 
OR of these two encoded streams is transmitted. Nonlinear turbo 
codes that provide a controlled distribution of ones and zeros are 
used to demonstrate a low-complexity scheme that operates close 
to the optimal boundary. 

Index Terms — broadcast channel, broadcast Z channel, capac- 
ity region, nonlinear turbo codes, turbo codes. 



I. Introduction 

Degraded broadcast channels were first studied by Cover in 
|[T] and a formulation of the capacity region was established 
in im, |I3| and (lU. Superposition encoding is the key idea 
to achieve the optimal boundary of the capacity region for 
degraded broadcast channels |5|. With superposition encoding 
for degraded broadcast channels, the data sent to the user 
with the most degraded channel is encoded first. Given the 
encoded bits for that user, an appropriate codebook for the 
second most degraded channel user is selected, and so forth. 
Hence superposition encoding is, in general, a joint encoding 
scheme. However, combining independently encoded streams, 
one for each user, is an optimal scheme for some broadcast 
channels including broadcast Gaussian channels HI and broad- 
cast binary-symmetric channels LU LZJ. 

Successive decoding is a natural decoding scheme for 
superposition encoding lU IS). With successive decoding 
for degraded broadcast channels, each receiver first decodes 
the data sent to the user with the most degraded channel. 
Conditioning on the decoded data for that user, each receiver 
determines the codebook for the user with the second most 
degraded channel and decodes that data, and so forth until the 
desired user's data is decoded. The performance of successive 
decoding for degraded broadcast channels is very close to 
optimal decoding under normal operating conditions. 

Turbo codes f6l and Low-Density Parity-Check (LDPC) 
codes [TJ perform close to the Shannon limit. LDPC and 
turbo coding approach for broadcast channels were studied 
in (HI and lH respectively. In |8|, LDPC codes provided 
reUable transmission over two-user broadcast channels with 
additive white Gaussian noise (AWGN) and fading known at 
the receiver only. In fOl, a superposition turbo coding scheme 
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Fig. 1. (a) Z channel, (b) Broadcast Z channel. 

performs within IdB of the capacity region boundary for 
broadcast Gaussian channels. Both of these approaches are 
designed specifically for broadcast Gaussian channels and used 
linear codes. For multi-user binary adder channels, nonlinear 
trellis codes were studied and designed in |10|. 

The Z channel is the binary-asymmetric channel shown in 
Fig. [11^). The capacity of the Z channel was studied in ifTTI . 
Nonlinear trellis codes were designed to maintain a low ones 
density for the Z channel in 1 12 1 1 14| and parallel concatenated 
nonlinear turbo codes were designed for the Z channel in ifTSll . 
This paper focuses on the study of the two-user broadcast Z 
channel X ^ ¥±,¥2 shown in Fig. [Itb). This paper provides 
an explicit expression of the capacity region for the two-user 
broadcast Z channel and shows that independent encoding with 
successive decoding can achieve the boundary of this capacity 
region. 

This paper is organized as follows. Section introduces 
definitions and notation for broadcast channels. Section |lll] 
provides the expUcit expression of the capacity region for 
the two-user broadcast Z channel and proves that independent 
encoding can achieve the optimal boundary of the capacity 
region. Section |IV] presents nonlinear-turbo codes designed 
to achieve the optimal boundary, and Section [V] provides the 
simulation results. Section [VTl delivers the conclusions. 



II. Definitions and Preliminaries 

A. Degraded broadcast channels 

The general representation of a discrete memoryless broad- 
cast channel is given in Fig.|2] A single signal X is broadcast 
to M users through M different channels Ai,--- ,Am- If 
p{yi,yi+i\x) = p{yi\x)p{yi+i\yi), then channel A^+i is a 
physically degraded version of channel Ai (and thus the 
broadcast channel X ¥i,¥i+i is physically degraded) 
15|. A physically degraded broadcast channel with M users 
is shown in Fig. |3] Since each user decodes its received 
signal without collaboration, only the marginal transition 
probabilities p{yi\x),p{y2\x), ■ ■ ■ ,p{yM\x) of the component 
channels Ai, A2, • • • ,Am affect receiver performance. Hence, 
the stochastically degraded broadcast channel is defined in ||2| 
and [5] as follows: 

Let Ai be a channel with input alphabet X, output alphabet 
3^i, and transition probability pi{yi\x). Let Ai+i be another 
channel with the same input alphabet X, output alphabet 
and transition probability pi+i{yi+i\x). Ai+i is a stochas- 
tically degraded version of Ai if there exists a transition 
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Fig. 2. Broadcast channel. 
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Fig. 3. Physically degraded broadcast channel. 

probability q(yi^i\yi) such that 

Pi+i{yi+i\x) = ^ q{yi+i 



\Vi)Pi{Vi\x)- 



(1) 



A broadcast channel with receivers 11 , 12 • • • , ^a/ is a 
stochastically degraded broadcast channel if every component 
channel Ai is a stochastically degraded version of Ai-i for 
all i = 2, • • ■ , M 12|. Since the marginal transition proba- 
bilities p[yi\x),p{y2\x),- ■ ■ ,p{yM\x) completely determine 
a stochastically degraded broadcast channel, we can model 
any stochastically degraded broadcast channel as a physically 
degraded broadcast channel with the same marginal transition 
probabilities. 

Theorem 1 f^): The capacity region for the two-user 
stochastically degraded broadcast channel X ^ Yi ^ Y2 is 
the convex hull of the closure of all (i?i,i?2) satisfying 



R2<I{X2;Y2) Ri < I{X;Yi\X2) 



(2) 



for some joint distribution p(x2)p(x\x2)p{yi 

#1 



auxiliary random variable X 

\X2\ <min{|A'|,|:yi|,|:y2|} 



y2\x), where the 
has cardinality bounded by 



B. The broadcast Z channel 

The Z channel, shown in Fig. [11 a), is a binary-asymmetric 
channel with the transition probability matrix 



T = 



1 a 

I- a 



where < a < 1. If symbol 1 is transmitted, symbol 1 is 
received with probability 1 . If symbol is transmitted, symbol 
1 is received with probability a and symbol is received with 
probability 1 — a. We can model the Z channel as the OR 
operation of the channel input X and Bernoulli noise N with 
parameter a as shown in Fig. |4] In an OR Multiple Access 
Channel, each user appears to transmit over a Z channel 
when the other users are treated as noise 1,1 3J . Thus, in an 
OR network with multiple transmitters and multiple receivers, 
each transmitter transmitting to more than one receiver sees 

'[/ was used as the auxiliary random variable in |2| |4|. In this paper, we 
use X2 instead of U because the auxiliary random variable corresponds to 
the second user's encoded stream. 
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Fig. 4. OR operation view of Z channel. 
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Fig. 5. Physically degraded broadcast Z channel. 

a broadcast Z channel if other transmitters transmitting to 
those receivers are treated as noise. The two-user broadcast 
Z channel with the marginal transition probability matrices 



ai 
1 — ai 



T2 = 



a2 
1-0:2 



is shown in Fig. [T] where < ai < 02 < 1- Because 
broadcast Z channels are stochastically degraded, we can 
model any broadcast Z channel as a physically degraded 
broadcast Z channel as shown in Fig. |5j where 



Q!2 — ai 
\ — ai 



(3) 



III. 



Optimal Transmission Strategy for the 
Two-User Broadcast Z Channel 



Since the broadcast Z channel is stochastically degraded, its 
capacity region can be obtained directly from Theorem [T] The 
capacity region for the broadcast Z channel X Yi Y2 
as shown in Fig. |6] is the convex hull of the closure of all 
i?2) satisfying 

R2<h=I{X2;Y2) 

= H{{fi.2l + A*2Mi)(l - "2)) 

- ^2H{^{1 - 02)) - f^2H{pi{l - 02)), (4) 
Ri<Ii^I{X;Y,\X2) 

= jM2{H{-f{l - ai)) - -iH{l - ai)) 

+ /i2(ii'(Mi(l-ai))-/iii?(l-ai)), (5) 

for some probabilities p,i,p2,J, where /ii = Pr(a; = 0\x2 — 
0), ^l2 ^ Pr{x2 = 0), 7 = Pr(x = 0|a;2 = 1), H{-) is the 
binary entropy function, fli = 1 — fl2 = 1-/^2 and 

a2 = Pr{2/2 - - 0} = 1 - (1 - ai)(l - a^). (6) 

Each particular choice of (/ii,^2,7) in Fig. |6] specifies 
a particular transmission strategy and a rate pair (/i,/2). 
The optimal boundary of a capacity region is the set of all 
Pareto optimal points (/i,/2), for which it is impossible to 
increase rate Ii without decreasing rate I2 or vice versa. A 
transmission strategy is optimal if and only if it achieves 
a rate pair point on the optimal boundary. We call a set 




Fig. 6. Infonnation theoretic diagram of the system. 

of transmission strategies sufficient if all rate pairs on the 
optimal boundary can be achieved by using these strategies 
and time sharing. Furthermore, a set of transmission strategies 
is strongly sufficient if these strategies can achieve all rate pairs 
on the optimal boundary without using time sharing. Equations 
(|4]l and (|5]l give a set of pentagons that yield the capacity 
region through their convex hull, but do not explicitly show 
the optimal transmission strategies or derive the boundary of 
the capacity region. 

A. Optimal transmission strategies 

The following theorem identifies a set of optimal trans- 
mission strategies and provides an explicit expression of the 
boundary of the capacity region. 

Theorem 2: For a broadcast Z channel with < ai < a2 < 
1, the set of the optimal transmission strategies (/xi,/U2,7), 
which satisfy 

7 = 0, (7) 
^ < Ml < 1, (8) 



(l-ai)(e-f^(i-"i)/(i-"i) + l) 



and 



{H{^ll{l - ai)) - ^iiH{l - ai)) • ln(l - - aa)) 
fui- n \\ n M 1 - /"2Ail(l - Q:2)x 



ln(l - ^1(1 - ai)), 



(9) 



are strongly sufficient. In other words, all rate pairs on the 
optimal boundary of the capacity region can be achieved by 
using exactly the transmission strategies described in (l7]|9]l 
without the need of time sharing. Furthermore, applying (|7} 
|9]) to (|4|i and Q yields an explicit expression of the optimal 
boundary of the capacity region. 

Before proving Theorem |2] we present and prove some 
preliminary results. From ^ and (|5]i, we can see that the 
transmission strategies (/ii, /12, 7) and (7, 1 — /i2, /ii) have the 
same transmission rate pairs. Therefore, we assume 7 < /ii 
in the rest of the section without loss of generality. 

Theorem 3: For a broadcast Z channel with < ai < a2 < 
1, any transmission strategy (/ii,/j,2,7) with < /i2 < 1,0 < 
7 < /ii is not optimal. 

The proof is given in Appendix A. 

Corollary 1: The set of all the transmission strategies with 
7 = is sufficient for any broadcast Z channel with < ai < 
a2 < 1. 

Proof: From Theorem [3] we know that the transmission 
strategy (/Xi,/i2,7) is optimal only if at least one of these 
four equations /^2 = 0, /X2 = 1, 7 = fii, 7 = is 



true. Hence the set of all the transmission strategies with 
/i2 = 0, /^2 = 1, 7 = /^i or 7 = is sufficient. When 
/i2 = 0, /i2 = 1 or 7 = /ii, the transmission rate for the 
second user, I2 in equation (|4|i, is zero. This optimal rate 
pair is the point B in Fig. EJa). Since this point can also be 
achieved by the transmission strategy with 7 = 0, /X2 = 1 and 
fii = argmax(iJ(a;(l — ai)) — xH{l — ai)), all the optimal 
rate pairs on the optimal boundary of the capacity region can 
be achieved by using the transmission strategies with 7 = 
and time sharing. Thus, the set of all the transmission strategies 
with 7 = is sufficient. Q.E.D. 

From Corollary [T] we can set 7 = in Fig. |6] without losing 
any part of the capacity region and so the designed virtual 
channel X2 — > X is a Z channel. Since we can consider the 
output of a Z channel as the OR operation of two Bernoulli 
random variables, an independent encoding scheme that works 
well for the broadcast Z channel will be introduced later in 
this paper. 

Applying 7 = to (l4]i and (|5]l yields 

R2<h= H{ii2iii{l - a2)) - Ai2i?(Mi(l - "2)), (10) 
Ri<h^ M2^r(Mi(l - ai)) - Ai2Mi^(l - ai)- (11) 

By Corollary [T] the capacity region is the convex hull of the 
closure of all rate pairs (i?i,i?2) satisfying (fTOl l and (fTTT i 
for some probability /ii,/i2- However, not all transmission 
strategies of (/xi,/i2,7 = 0) achieve the optimal boundary of 
the capacity region. Since any optimal transmission strategy 
maximizes Ii + A/2 for some nonnegative A, we solve the 
optimization problem of maximizing Ii + A/2 for any fixed 
A > in order to find the constraints on and ^2 for optimal 
transmission strategies. Theorem|4]provides the solution to this 
maximization problem. 

Theorem 4: The optimal solution to the maximization prob- 
lem 

maximize /i + A/2 (12) 
subject to I2 = //(m2Mi(1 - "2)) - /"2//(/"i(l - "2)) 

h = ^J^2H{^ll{l - ai)) - ii2lJ-iH{l - Qi) 

< A*2 < 1,0 < Ail < 1, 

is unique and it is given below for any fixed A > 0. 
Define 

ln(l - {l-ai)x) 



and 



ip{x) 



ln(l - (1 - a2)a;) 



1 



(13) 



(14) 



Case /.• if < A < (/3(^/'(l — ai)), then the optimal solution is 
/I2 = 1, /^i = ^(1 " Q!i), which satisfies ^ and (|9]), and the 
corresponding rate pair is = //(/i*(l — ai)) — /^J//(l — ai). 



I* - 0. 



Case 2: if A > ip{l), then the optimal solution is /ij — 
7/1(1 — a2),Mi ~ 1' which also satisfies ([8]) and and the 
corresponding rate pair is = 0,^ — //(/i2(l — 0:2)) — 
M^//(l-a2). 

Case 3: if (^(-0(1 — ai)) < A < (p{l), then the optimal solution 
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Fig. 7. (a) The capacity region and two upper bounds, (b) Point Z cannot 
be on the boundary of the capacity region. 



given below also satisfies (O and (|9]i: 



Ml 



e^(l-a2)-(l-ai) 



(15) 



and 



(iI(Mt(l-ai))-Mt^^(l 
= (iJ(/it(l-a2))-Mt(l- 
•ln(l-AiJ(l-ai)). 



a2) In 



) 

(16) 



The proof is given in Appendix B. Combining Case 1,2 
and 3, we conclude that (/ii,/i2) is a maximizer of (fTZt if 
and only if the pair (/ii,/i2) satisfies (|8]l and (|9]l. In other 
words, if (/xi,/i2) doesn't satisfy (HJ or (|9]l, {^1,^2) cannot 
be a maximizer of (fT2] l. and thus the transmission strategy 
(/ii, /i2, 7 = 0) is not optimal. Since the set of the transmission 
strategies with 7 = is sufficient by Corollary [T] the set of 
all the transmission strategies satisfying (|7]|9]l is also sufficient. 
Therefore the capacity region is the convex hull of the closure 
of all rate pairs (i?i,i?2) satisfying ( fTOl i and (fTTT i for some 
/^i,M2 which satisfy dHJ and (|9]l. 

A sketch of the capacity region is shown with two upper 
bounds in Fig. |3a). From Case 1 in Theorem |4] the point B 
corresponds to the largest transmission rate for the first user 
The first upper bound is the tangent of the capacity region at 
the point B, and its slope is —l/(p{ip{l — ai)). From Case 
2, the point A provides the largest transmission rate for the 
second user The second upper bound is the tangent of the 
capacity region at the point A, and its slope is ~l/ip{l). Case 
3 gives us the optimal boundary of the capacity region except 
the points A and B. 

Given ai and a2, which completely describe a two-user 
degraded broadcast Z channel, the optimal boundary of the 
capacity region can be explicitly described by dSlfTTTi. For any 



/ii in the range of (|8]l, the value of the unique associated /i2 
follows from (|9]l. The curve of the optimal boundary of the 
capacity region is then the set of (/i,/2) pairs satisfying (fTOl i 
and (fTTT i for these and associated /i2. For example, for 
ai — 0.15 and a2 — 0.6, the range of optimal /ii values is 
0.445 < /ii < 1, the range of optimal 112 values implied by 
(|9]l is 0.392 < /i2 < 1, and the associated capacity region 
boundary is plotted in Fig. [13] 

Now we prove Theorem|2] Since we have proved that the set 
of all the transmission strategies satisfying (|7]|9]l is sufficient, 
we only need to show that any rate pair on the optimal 
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Fig. 8. Communication system for 2-user broadcast Z channels. 
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Fig. 9. Optimal transmission strategy for broadcast Z channels. 

boundary of the capacity region can be achieved without using 
time sharing. 

Proof by contradiction: Suppose the point Z in Fig. [Tjb) 
is on the optimal boundary of the capacity region for the 
broadcast Z channel and this point can only be achieved by 
time sharing of the points X and Y, which can be directly 
achieved by using transmission strategies satisfying (|7]|9]l- 
Clearly, the slope of the line segment XY is neither zero nor 
minus infinity. Denote — fc,0<A;<ooas the slope of XY. 
The points X and Y provide the same value of Ii + ^l2- By 
Theorem m the optimal solution to the maximization problem 
of max(/i +A/2) is unique, and so neither X nor Y maximizes 
(/i + i/2). Thus, there exists an achievable point P such that 
this point is on the right upper side of the line XY. Since 
and the triangle AXYP is in the capacity region, the point 
Z must not be on the optimal boundary of the capacity region 
(contradiction). Q.E.D. 



B. Independent encoding scheme 

The communication system for the two-user broadcast Z 
channel is shown in Fig. |8] In a general scheme, the trans- 
mitter jointly encodes the independent messages Wi and W2, 
which is potentially too complex to implement. Theorem |2] 
demonstrates that there exists an independent encoding scheme 
which achieves the optimal boundary of the capacity region. 
Since 7 = is strongly sufficient, the designed channel 
X2 ^ X is a Z channel. Thus, the broadcast signal X can be 
constructed as the OR of two Bernoulli random variables Xi 
and X2. This construction of X is an independent encoding 
scheme. The system diagram of the independent encoding 
scheme is shown in Fig. |9] First the messages Wi and W2 
are encoded separately and independently. Xi and X2 are 
two binary random variables with Pr{Xj = 1} = jlj and 
Pr{Xj = 0} = /ij, where fij + Hj = 1 for j = 1,2. 
The transmitter broadcasts X, which is the OR of Xi and 
X2. From Theorem 12] this independent encoding scheme with 
any choice of {^1,^.2) satisfying ([8]l and (|9]l achieves a rate 
pair (Ji, J2) arbitrarily close to the optimal boundary of the 
capacity region if the codes for Xi and X2 are properly chosen 
and have sufficiently large block lengths. 




Fig. 10. 16-state nonlinear turbo code structure, with ko 
trellis section. 

TABLE I 

Labeling for constituent trellis codes. Rates 

Rl = 1/6, i?2 = 1/6. Rows represent the state S1S2S3S4, COLUMNS 

represent the input uiU2 . Labeling in octal notation. 
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(a) User 1 : Z channel with erasures 
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(b) User 2: Z channel 



IV. Nonlinear-Turbo Codes for the Two-User 
Broadcast Z Channel 

In this section we show a practical implementation of the 
transmission strategy for the two-user broadcast Z channel. 
As proved in Section |llll the optimal boundary is achieved 
by transmitting the OR of the encoded data of each user, 
provided that the density of ones of each of these encoded 
streams is chosen properly. Hence, a family of codes that 
provides a controlled density of ones is required. We use 
the nonlinear turbo codes, introduced in f\3\, to provide the 
needed controlled density of ones. Nonlinear turbo codes are 
parallel concatenated trellis codes with ko input bits and no 
output bits per trellis section. A look-up table assigns the 
output label for each branch of the trellis so that the required 
ones density is achieved. Each constituent encoder for the 
turbo code in this paper is a 16-state trellis code with ko — 2 
and the trellis structure shown in Fig. [TO] The output labels 
are assigned via a constrained search that provides the required 
ones density for each case, using the tools presented in I.13J 
for the Z Channel. The output labels for the codes with rate 
pair = 1/6, R2 = 1/6), which is simulated on a broadcast 
Z channel with ai = 0.15, a2 = 0.6, are listed in Table H] 

Receiver 1 uses successive decoding as shown in Fig. [TT] 
Denote as X2 the decoded stream corresponding to user 2. 
Since the transmitted data is a; = xi(OR)a;2, whenever a bit 
X2 — 1, there is no information about xi, and Xi can be 
considered an erasure. Hence, the input stream to Decoder 1 



Fig. 12. Perceived channel by each decoder. 



IS 



yi = e{yi,X2) = 



yi if f 2 = 0, 
e if 2:2 = 1- 



(17) 



Therefore, Decoder 2 sees a Z Channel with erasures as 
shown in Fig. [12] The tools presented in lfT3l were general 
enough to be applied to the Z Channel with erasures. Note 
that if ai is much smaller than a2 we can use hard decoding 
in Decoder 2 instead of soft decoding without any loss in 
performance. Since the code for user 2 is designed for a Z 
Channel with 0-to-l crossover probability 1 — (1 — 02) /ii, and 
the channel perceived by Decoder 2 in user 1 is a Z-Channel 
with crossover probability 1 — (1 — ai)/ii < 1 — (1 — 02)/.*!, 
the bit error rate of X2 is negligible compared to the bit error 
rate of Decoder 1. In fact, in all the simulations shown in 
Section FVl which include 100 frame errors of user 1, none of 
the errors were produced by Decoder 2. 

V. Results 

We simulate the transmission strategy for the two-user 
broadcast Z channel with crossover probabilities ai = 0.15 
and a2 — 0.6, using nonlinear turbo codes, with the structure 
shown in Fig. [TO] Fig. [13] shows the capacity region for the 
broadcast Z channel and identifies the simulated rate pairs. It 
also shows the optimal rate pairs, which are used to compute 
the ones densities of each code. The output labels for the codes 
with each simulated rate pair are listed at [15|. For each of 
these four simulated rate pairs, the loss in mutual information 
from the associated optimal rate is only 0.04 bits or less in 
Ri and only 0.02 bits or less in i?2- Table [III shows bit error 
rates for each rate pair, the ones densities jli and fL2, and 
the interleaver lengths Ki and K2 used for each code. For 
simplicity, we chose Ki and K2 so that the codeword length 
n would be the same for user 1 and user 2, except for rate 
pairs i?i = 1/2 and R2 = 1/22, where one codeword length 
of user 2 is twice the length of user 1. 

VI. Conclusions 

This paper presented an optimal transmission strategy for 
the broadcast Z channel with independent encoding and suc- 
cessive decoding. We proved that any point on the optimal 



TABLE II 

BER FOR TWO-USER BROADCAST Z CHANNEL WITH CROSSOVER PROBABILITIES Ol = 0.15 AND Ol2 = 0.6. 
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Fig. 13. Broadcast Z channel with crossover probabilities ai = 0.15 and 
02 = 0.6 for receiver 1 and 2 respectively: achievable capacity region, 
simulated rate pairs (Ri, R2) and their con'esponding optimal rates. 



boundary of the capacity region can be achieved by inde- 
pendently encoding the messages corresponding to different 
users and transmitting the OR of the encoded signals. Also, 
the distributions of the outputs of each encoder that achieve 
the optimal boundary were provided. Nonlinear-turbo codes 
that provide a controlled distribution of ones and zeros in their 
codewords were used to demonstrate a low-complexity scheme 
that works close to the optimal boundary. 



Appendices 

Appendix A 

Here we prove Theorem [5] which states that for a broadcast 
Z channel with < ai < q;2 < 1, any transmission strategy 
{Hi, ^2, 7) with < /i2 < 1, < 7 < /ii is not optimal. 

In dU and denote 



Il{^ll,m,l) = I{X;Y,\X2)\ 
h{fJ'i,m,l) = I{X2;Y2)\ 

'Mil 



(18) 
(19) 
(20) 



The transmission strategy (/ii,^2,7) achieves the rate pair 
^1,2(^1, M2, 7)- The theorem is true if we can increase both Ii 
and I2 when 0<^2<1,0<7< /ii. 

First compare the strategies (/ii,/i2,7) and {^i + 




Fig. 14. Capacity region and the changes of rate pairs. 

^2^1, M27 7 — M2<5i) for a small positive number Si > 0. 

Ai/i =/i(/ii +/i2^i,Ai2,7~A^2^i) - Il{^J.l,^J.2,l) 



dSi 



Si=Q 



Si 



1 - 7(1 - ai) 



'M2M2(1 - Q!i)| In- 

L 7(1 -ai) 

/ii(l - ai) 



1 - yUi(l - ai) J 



<0, 



(21) 



and 



A1/2 



hini + ^J-2Sl,^J,2,l - ^J■2Sl) -/2(mi:M2,7) 

dhip-i + /i2(5i, ^2,7 - ^J■2Sl) 



dSi 



Si=Q 



Si 



^2^2(1 - a2)| In 



In 



1 - 7(1 ~ a2) 

7(1 - "2) 
/ii(l - 0:2) 
1 - /ii(l - 02) 



> 0. 



(22) 



The small change of the rate pair (Ai/i,Ai/2) is shown 
Fig. [14] Point A is the rate pair of the transmission strategy 
(/Lti, /Lt2, 7), the arrow Ai shows the small movement of the 
rate pair (Ai/i, A1/2). 

Second compare the strategies (/ii,/i2,7) and (/ii + (7 — 
/ii)(52,/i2 + ^2(52, 7) for a small positive number S2 > 0. 

A2/1 = hini + (7 - ^J■l)S2,^J■2 + A*2'52,7) - -^1(^17/^2,7) 



+ (7 - Ml)'^2,M2 + ^2(52, 7) 



dS2 



S2=0 



-M2'^2|7(l - ai) 



In 



Ml 

7 



+ (l-7(l-ai))ln 



1 - Mi(l - "1 



.1 -QiJ ] 
l-«i) J 



1-7(1-' 
= ^2(^2 £'(7(1 - ai) II Mi(l - "i)) 
> 0, (23) 



and 

A2/2 = hipi + (7 - Ail)^2,/^2 + /i2^2,7) - -^2(^^1,^2,7) 
9/2(^1 + (7 - /^l)'52,M2 + M2<52,7) 



9,52 



^2(5217(1 - "2) In 



Ml 

7 



+ (l-7(l-«2))lni^Ml^} 
1 - 7(1 - 02) J 

-/i2(52£'(7(l - 02) II Mi(l - "2)) 



< 0, 



(24) 



where Z?(p || g) is the relative entropy between the distri- 
butions p and q. The arrow A2 in Fig. [14] shows the small 
movement of the rate pair (A2/1, A2/2)- 
Now we show that 



A1J2 A2/2 p 
Ai/i ^ A2/1 



(25) 



A1/2 A2/2 
Aih ^ A2/1 



jJ(7(l - a2) II - a2)) + In ^7/(1!"^,^) 

i?(7(l-ai) ||Mi(l-^i))+ln /_7/(\l"j)) 

jJ(7(l-a2) 11 m(l-«2)) 
i?(7(l-ai) II /xi(l-ai)) 
Z)(7(l -ai) ||Aii(l -ai)) i?(7(l -"2) ||mi(1 -"2)) 



lniz:2(iz£il 

1— /il(l — ai) 



> 



l-7(l-«2) 
1— /Jl(l — 0:2) 



0(72; II /iia;) 

<^ / (a;) — — ^ — is monotonically increasing in < a; < 1 



In-i^ 

l — fj,ix 



n^) = { 



In 



In^I^ln.^ 

7X , 



7a; 



In- 



1 



7a; X 2 



1 — /ilX ^ 1 — jiix' 

1 1 N ~1 / , 1 — 7a; 



/iia; 1 — 7X 



> 0. 



(26) 



Let a = 1 — 72: and 6 — 1 — ^ix. We have < < a < 1 
and want to show that 



g{a,b) 
Since 

and 



b 1-6 







a 

























dadb 
dg{a,b) 



{a-bf 



it is true that 



da 

dg{a,b) 
da 



a^^{l - a){l -b) 
= VO < a < 1, 

b—a 

>0 V0<6<a<l. 



< 0, 



> 0. 
(27) 

(28) 
(29) 

(30) 



It follows from and the fact g{b, 6) = 0, VO < 6 < 1 that 
5(0,6) > 0,V0 < 6 < a < 1. Thus, the inequality (|25j is 
true, which means that the slope of Ai is smaller than that of 
A2 in Fig. [14] Hence, the achievable shaded region is on the 
upper right side of the point A. Therefore, we can increase 



both terms in the rate pair /i.2(mi, M2, 7) simultaneously and 
the strategy (^1,^2,7) is not optimal when < /i2 < 1 and 
< 7 < Ml. Q.E.D. 

Appendix B 

Here we prove Theorem ID which provides the unique 
optimal solution to the maximization problem ( fT2] i. In problem 
(fTSl i. the objective function /i + A/2 is bounded and the domain 
< Ml , M2 < 1 is closed, so the maximum exists and can be 
attained. First we discuss some possible optimal solutions and 
then we show that only one of them is optimal for any fixed 
A > 0. 

Case 0: If /ii = or /i2 = or /ii = /i2 = 1, then /i = /2 = 
and so it cannot be optimal. 

Case 1: If /i2 = 1 and < mi < 1, then /2 = and 
1 - Mi(l - "1) 



OMi 



ai) In ■ 



Mi(l - ai) 



^MI = 



H{1 - ai) = (31) 
(32) 



(1 -ai)(e^(i-"i)/(i-"i) + 1)' 
Case 2: If /ii = 1 and < M2 < 1, then /i = and 

|^ = (l-02)ln ^-^;f -"^) -g(l-.2) = (33) 
c'M2 M2(l-a2) 



1 



M2 = 



(34) 



(1 -a2)(e^^(i-°2)/(i-"^) + 1)' 
Case 3: If < mi, M2 < 1, then the optimum is attained when 



M2- 



dih + A/2) 9(/i + A/2) 



9m2 dfii 
ln(l - /it(l - ai)) = Aln(l - ^4(1 



= 
- "2)), 



(35) 



and 



d{h + A/2) 



= 



0:2)) - Mi(l - 0:2) In 



1 - M2Mt(l - "2) 
M2Mt(l -"2) 

{HifiUl - a,)) - filHil - a,)) ■ ln(l - mI(1 - "2)) 

1 - M5Mt(l - "2) 



ln(l-Mt(l-ai)). 



02) In ■ 



M2Mt(l - "2) 



(36) 



For any fixed A > 0, the optimal solution is in Case 1, 2, 
or 3. 

Lemma 1: Function ip{x) — is monotoni- 

cally increasing in the domain of < a; < 1 when a\ < a^- 
Lemma 2: The solution in Case 1 cannot be optimal when 

A > ^(V'(l -ai)). 
Proof: When M2 = 1 and /ii = 

#^ = 0. Therefore, for any fixed A, ^^^^+^^^y = Q. When 
A = 'y3(Mi) = ¥'('0(1 ~ Oil)), ( 1351 ) holds, and so 



a(/i+A/2) 



9m2 



A'2 = l,A'l='0(l-ai) 



d{h + <y3(VXl - «l))/2) 



9m2 



^i2 = l,/ii='/'(l-ai) 



0. 



(37) 



When A > ip{tp{l - ax)). 



- ax)) < A < Lp{\). From ( |36] |. 



d{h + A/2) 
5/1 



A'2 = l,/il='!/'(l~"l) 

+ A- 



d\li ;i2 = l./Jl='i/'(l-ai) 9/i2 A'2 = l,A'l=i/'(l-ai) 

< — + - ai))^ — 

/i2 = l./Jl='i/'(l — ctl) CM2 



9^2 

+ </j(7/^(l - ai))/2) 



9^2 



A'2 = l,A'l='A(l-ai) 
M2 = l,Ml=V'(l-ai) 

(38) 



where (a) follows from the facts that 

ln(l - ^(1 - ax) ■ (1 - 02)) < and A > \p{^{\ - ai)), and 
(b) follows from ( l37T i. Therefore, Case 1 cannot be optimal 
when A > (^(V^l - ax)). Q.E.D. 

Lemma 3: The solution in Case 2 cannot be optimal when 
A <¥'(!). 

Proof: When ^2 = — ^2) and ^1 = 1, = and 
#^ = 0. Therefore, for any fixed A, ^^V^'^"'' = 0. When 

OfJ,2 ■' OfJ.2 

A = ifinx) = '^3(1), (ED holds, and so 



M2 = l,A'l='/'(l-"i) 



+ AJ2) 



dfix 



fJ.2=i('{l-a2),fJ.i=l 



d{Ix + (^(l)/2) 



9^1 



/J2='/'(l-a2),A»l=l 



= 

When A < (^(1), 
+ AJ2) 



(39) 



djJLx 

9/X2 
a dix 

dfi2 



fi2=i>il-a2). 1-11 = 1 
/J2='i/'(l-a2),A'l = l 0'/i2 



/J2='0(l-a2),A'l = l 



M2=V'(l-"2),Ail=l 

/i2=V'(l-"2),Ml=l 



M2='/'(l-a2),Ml = l 



(40) 



where (a) follows from the facts that 



A'2='/'(l-a2),Ml = l 



— ^'(l — a2)lna2 > and A < ip{l), and (b) follows from 
( |39] l. Therefore, Case 2 cannot be optimal when A < 
Q.E.D. 

Lemma 4: The solution to ( l35T l exists in (0, 1) and is unique 
for any A in the range of 1^9(0) < A < f{l)- 

Proof: Equation (l35T l is equivalent to ^p{^\) = A. From 
Lemma[ri ip{fJ.x) is monotonically increasing. Therefore, when 
Lp{0) < A < ip{l), the solution /^|is unique and /i| e (0, 1). 
Q.E.D. 

Lemma 5: The unique solution , /ij ) to ( l35T l and (l36T l in 
Case 3 is optimal if (p{^/j{l — ax)) < A < <^(1). 

Proof: From Lemma |4] the solution /i^ to (l35T l is unique if 



771(^2) 



{F(Mt(l-a2))-Mt(l-«2)ln 



1 - ^J.2^J■li^ - a2) ■ 



^2Ml(l-"2) J 

• ln(l - - ax))~{H{^Ilil - ax)) - - ax)} 

•ln(l-Ml(l-a2)) 
- 0. (41) 

Clearly, m(/i2) is monotonically increasing, 

(42) 



_ and 



lim m(/i2) = — cxD < 0, 

M2^0 



^(V-ll -ai)) < A < ip{l) 
^li*x >ij{l-ax) 
^m(l) > 0. 



(43) 



That means the unique solution ^2 to ( 136b is in the domain of 
< /^2 < 1- Furthermore, when (p{tp{l — ax)) < A < ip{l), by 
Lemma |2] and Lemma [3] Case 1 or Case 2 cannot be optimal 
because 

dih + A/2) I 



dfj.2 

d{Ix + A/2) 
d^Lx 



l/'2 = l,Ail='</'(l-ai) 



1^11=1, ^i2='/'(l-a2) 



<o, 



< 0. 



(44) 



(45) 



Therefore, Case 3 is optimal. Q.E.D. 

Lemma 6: The unique solution (/i2 = 1tIJl\= "0(1 — ax)) 
in Case 1 is optimal if < A < <i3(V'(l — ax))- 

Proof: When < A < </j('0(1 — ax)). Case 3 is not optimal 
because there is no solution /^i £ (0, 1) to ( |35] |. Case 2 is not 
optimal by Lemma [3] Hence, Case 1 is optimal. Q.E.D. 

Lemma 7: The unique solution (/i2 — V'll ~ <^2),Aii = 1) 
in Case 2 is optimal if A > 1^9(1). 

Proof: When A > tf{\). Case 3 is not optimal because there 
is no solution ^2 G (0,1) to ( [36] l. Case 1 is not optimal by 
Lemma |2] Hence, Case 2 is optimal. Q.E.D. 

From Lemma |5|6] and 171 Theorem]?] is immediately proved. 
Q.E.D. 
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